feat(gateway): support images and audio for LINE/Telegram#726
Closed
iamninihuang wants to merge 8 commits intoopenabdev:mainfrom
Closed
feat(gateway): support images and audio for LINE/Telegram#726iamninihuang wants to merge 8 commits intoopenabdev:mainfrom
iamninihuang wants to merge 8 commits intoopenabdev:mainfrom
Conversation
Loading
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Added support for incoming images and audio/voice messages for LINE and Telegram adapters.
The Custom Gateway currently only supports text messages. This PR implements a Media Proxy that downloads media from platform APIs (which require auth) and serves it at a temporary local HTTP endpoint. This allows OpenAB Core and AI agents to fetch and analyze media via standard URLs, mirroring the image-understanding workflow already present in the Discord adapter.
Features
attachmentsfield toGatewayEventto propagate media URLs to the agent.Testing
cargo test— 96 passedcargo clippy— 0 warningsBreaking Changes
None. Added optional
attachmentsfield to the gateway event schema. New environment variablesGATEWAY_MEDIA_BASE_URLandGATEWAY_MEDIA_STORE_TTLhave safe defaults.Discord Discussion URL
https://discord.com/channels/1491295327620169908/1500160821567684660/1499859716409393172
Closes #690